VIDEO HARDWARE 
GETS SMART 


Bill Etra has combined video and computer technologies in an 
SEG that can control the entire teleproduction process 


by Peter Caranicas 


ee a special-effects generator 
that’s also a video switcher, an image 
manipulator, a colorizer and a hy brid 
analog-digital computer for video. 
Imagine that it can perform a_ full 
range of special effects, do infinite- 
reentry video-switching under com- 
puter control and be used by a single 
operator as a control center for auto- 
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matic preprogramming of an entire tv 
production, including remote control 
of the cameras, integration of lighting 
changes, actor cueing, prompter- 
device coordination—all without the 
necessity for cameramen, audio engi- 
neers, lighting directors and tv direc- 
tors. 

Such are the claims of the In- 
telligent Video System (IVS), a device 
combining many recent refinements 


in video and computer science, which 
leapfrogs the complex technology of 
existing television switching equip- 
ment. The majority of today’s produc- 
tion switchers are based on technical 
advances built up piecemeal over the 
years, with each step forward simply 
added on to existing systems. IVS is 
an attempt to wipe the video-switcher 
slate clean and to include all the tradi- 
tional switching functions, as well as 
some new ones, in a state-of-the-art 
system. 

Some would describe IVS as a video 
synthesizer, although it cannot twist 
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Left and below: Etra experimenting at home 


and decompose images and parts of 
images in the manner of a raster-scan 
synthesizer. It does process images, 
however, by changing their shapes 
and colors. 

IVS is the brainchild of Bill Etra 
who, together with Steve Rutt, devel- 
oped the Rutt-Etra video synthesizer, 
a raster-scan machine now used by 
several tv post-production facilities. 
Etra is presently assistant professor of 
fine arts at the University of Mary- 
land, and divides his time between 
teaching there and experimenting at 
his Joft in New York City. His main in- 
terest is video as a compositional 
tool—or video art—and he recently 
received a $13,000 grant from the Na- 
tional Endowment for the.Arts and 
Humanities and the New York State 
Council on the Arts for research in 
that area. 

Etra conceptualized IVS while ex- 
ploring new ways of creating software 
and spent 2% years developing it. 
But, although IVS was originally in- 
vented as an aid for video artists, it 
turned out to have important applica- 
tions in bread-and-butter tele- 
production work. 

The heart of IVS is described as a 


~% matrix switcher that can switch faster 


than the resolution of a tv picture. A 
logic pulse turns on any points of the 
matrix to which it is addressed. A 
ramp control voltage fades up the ma- 
trix switcher. Two keywipe generators 
wipe a key to any shape in the matrix. 
Because the system’s user deals with 
a matrix rather than a traditional 
downstream switcher, IVS allows re- 
sults to be reentered at any matrix 
point for further processing. The ma- 
trix switcher is accompanied by a 
four-level key colorizer which, when 
used in combination with the matrix, 
permits levels of colorization that are 
virtually infinite. 

In its simplest form IVS can do 
multilevel keys, fades, dissolves, digi- 
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Using still video images of coral and wo- 
man’s face, IVS can produce effects such as 


(top, | to r) color key of coral with face in- 
serted at level 4, key of coral with different 
color inserted at each level, and with com- 
puter matrix brought back in negative at 
level 2; and (above, | to r) a quantization of 
the coral with computer matrix filling level 1 
and the face inserted into the highest level, a 
color negative of the same, and both the face 
and the computer matrix in negative at dif- 
ferent levels. 


tal and analog outlinings, hard- and 
soft-edge colorizing, additive and 
nonadditive mixing wipe shapes, and 
so forth. Options include wave-form 
generation for more complex wipe 
shapes, coded chroma-key edge sharp- 
ening and an adaptor box to interface 
it with various audio synthesizers. 
Because its construction is modular, 
its Options can be extended without 
making any parts obsolete. 

IVS can be programmed with calcu- 
lator-pad pushbuttons, which are 
used to insert whole sections of mem- 
ory into the computer, and then com- 
manded with a typewriter keyboard in 
relatively simple English: “‘Wipe; dis- 
solve camera 3.”’ By incorporating 
specific control boards, other exten- 
sions can be added to IVS, including 
servo controllers for remote camera 
units. A manual override panel will be 
available, however, to enable manual 
control of complicated sequences. 

For postproduction work, part of 
the IVS system is an infinite posi- } 
tioner that can change the position of 
a prerecorded video picture and ap- 
proximate any lost background or 
light level by sampling a reference 
selected by the operator using the 
manual override. In this way he or she 
can correct framing errors, leave the 
desired parts of a picture sharp and 
soften a scene’s unwanted details. 

A startling function of the complet- 
ed IVS system will be its ability to 
translate videotape and film programs 
originally shot in black-and-white into 
color—a color that is a close approxi- 
mation of the color that existed when 
the film or tape was originally pro- 
duced, and which was lost. The process 
is a complex one because light- 
ing—and therefore the various gray 
shades that represent the original 
colors—may change from scene to 
scene. For that reason no process of 
standard gray-level colorizing has 
heretofore worked well. 
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Above: image produced by using a soft- 
edged diamond to highlight a monochrome 
face over colorized coral. Below (top to bot- 
tom): face used to cut key for colorizer with 
coral video in layer 4; same, but with outline 
of coral.in hue of layer 4; colorizer used for 
wipe function with images inserted in dif- 
ferent layers. 
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The IVS computer-colorizer is de- 
signed to circumvent these problems 
by allowing the hand-colorizing of 
specific frame areas, which can be 
“painted’’ by using a light pen on a 
monitor screen. The first frame of any 
scene—which in this context means 
continuous light conditions and ab- 
sence of any movement—is_ hand- 
colored. The computer then locks 
onto the gray-scale balance of the 
frame, continuing to colorize sequen- 
tial frames until it detects a change in 
the gray scale. It then stops the tape 
or film, automatically back-spaces to 
the appropriate frame, and the 
process is repeated. 

In scenes with definable back- 
ground and characters, a more com- 
plex mode of operation can be used: 
people can be separated from the 
background by brightness, distin- 
guished separately, and automatically 
tracked from frame to frame until the 
conditions no longer exist. The de- 
gree of automation with which this 
can be accomplished depends entire- 
ly on the amount of computer power 
dedicated to pattern-recognition. Per- 
haps when the age of consumer video 
finally dawns, cdlorized versions of 
Charlie Chaplin and D.W. Griffith will 
be made available. 

The IVS system will be marketed by 
Intelligent Video Systems Corp., a 
company to be set up by Visiondisc, 
Inc., a videodisc software concern. 
The basic core of the system will be 
priced at $8,500 or less. Adding com- 
puter features and the manual over- 
ride will bring the price up to the 
$50,000 range. 

These costs are based upon rela- 
tively modest production runs. They 
will, nevertheless, entail extensive 
marketing efforts. To this end, Vision- 
disc is approaching major broadcast 
equipment manufacturers and dis- 
tributors. The main target would not 
necessarily be broadcasters but 
would extend to the world of educa- 
tional and industrial television as well 
as to experimental video groups. 

IVS's backers claim that the era of 
eyeball-judged video is set to sup- 
plant the era of instrument-judged 
video, making the system acceptable 
for all but the highest end of telepro- 
duction. Its major advantage will be 
its ability to cut down on maintenance 
and personnel costs. If part of the sys- 
tem malfunctions, all that will be 
required to make the correction will 
be the replacement of a board. More 
important, a single director is all 
that’s needed to program the com- 
puter controlling the cameras, lenses 
and lights. If IVS lives up to its prom- 
ise, complex teleproduction and spe- 
cial effects will come within the reach 
of many groups who cannot afford 
them today. . 


Above (top to bottom): colorizer used again 
for wipe function with images inserted in dif- 
ferent layers; special wipe shape; colorizer 
used as shape generator with low chromin- 
ance in layer 3 and low luminance in layer 1. 
Below: wipe into colorizer, color inserted 
without video. All photos: computer work by 
Lou Katz. 
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